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Abstract-Automatic  Change  Detection  (ACD)  compares  new 
and  stored  terrain  images  for  alerting  to  changes  occurring  over 
time.  ACD  techniques,  long  used  in  airborne  radar  applications, 
are  just  beginning  to  be  applied  to  sidescan  sonar.  In  Coherent 
Change  Detection  (CCD)  the  cross-correlation  of  multi-temporal 
complex  data  collected  from  coherent  imaging  sonars  detects 
changes  in  the  transduced  amplitudes  and  phase  of  image  pixels 
which,  under  the  right  conditions,  can  be  used  to  detect  new  ob¬ 
jects  or  disturbances  on  the  seafloor.  Synthetic  aperture  sonars 
(SAS)  produce  range-independent,  fine  resolution  seafloor  images. 
With  centimetric  resolution  demonstrated  out  to  hundreds  of  me¬ 
ters,  these  coherent  systems  can  classify  small  manmade  objects  at 
long  ranges,  and  should  be  suitable  for  CCD. 

This  paper  describes  experiments  testing  CCD  with  data  from 
synthetic  aperture  sonars  mounted  on  autonomous  undersea  ve¬ 
hicles  and  actively  navigated  tow  bodies.  A  noncoherent  example 
carried  out  with  data  collected  from  an  AUV-mounted  SAS  de¬ 
monstrates  the  utility  of  correlation-based  automatic  change  de¬ 
tection.  CCD  tests  were  carried  out  with  repeat  pass  data  col¬ 
lected  using  a  SAS  mounted  on  a  dynamically  controlled  tow  ve¬ 
hicle.  While  simple  image  pair  co-registration  procedures  failed  to 
provide  sufficient  coherence  in  the  overall  scene  required  for 
CCD,  preliminary  tests  of  image  warping  techniques  used  for 
airborne  radar  applications  show  promise  of  transitioning  suc¬ 
cessfully  into  the  SAS  signal  processing  chain. 

I.  Introduction 

Since  the  terrorist  attacks  of  September  2001,  concern  on 
how  best  to  protect  ports  and  water-ways  continues  to  grow. 
As  techniques  for  inspecting  cargo  containers  and  surveilling 
small  craft  and  swimmers  become  operational,  countering  the 
threat  of  mines  or  improvised  explosive  devices  (IED)  placed 
in  sea  lanes  is  beginning  to  be  addressed.  Effective  counter¬ 
measures  must  combine  gathering  and  acting  upon  intelligence 
that  a  mining  event  is  about  to  occur,  periodic  mapping  of  in¬ 
gress/egress  routes  to  catalog  and  classify  newly  appearing 
objects,  and  effective  coordination  of  explosive  ordnance  dis¬ 
posal  capabilities. 

Harbors  and  high  volume  traffic  lanes  typically  have  large 
quantities  of  debris  resembling  potential  targets  that  can  easily 
saturate  conventional  sonar  detection  approaches.  Thus  auto¬ 
matic  change  detection  (ACD)  techniques  pioneered  in  air¬ 


borne  radar,  comparing  new  and  stored  terrain  images  to  alert 
changes  over  time,  are  being  evaluated  for  use  in  bottom  sur¬ 
veys  that  utilize  seafloor  mapping  sonars.  In  this  application, 
bottom  imagery  from  periodic  surveys  is  used  to  maintain  a 
database  of  historical  (benign)  objects  and  to  detect  the  appear¬ 
ance  of  new  potential  threats. 

This  paper  describes  preliminary  experiments  of  applying 
coherent  change  detection  (CCD)  techniques  for  detecting  the 
presence  of  manmade  objects  newly  laid  in  estuary  environ¬ 
ments.  The  systems  considered  are  the  EdgeTech  4400  synthet¬ 
ic  aperture  sonar  (SAS)  deployed  on  a  HUGIN  1000  autonom¬ 
ous  undersea  vehicle  (AUV)  and  an  Applied  Signal  Technolo¬ 
gy  (AST)  SAS  deployed  on  a  MacArtney  FOCUS-2  Remotely 
Operated  Tow  Vehicle  (ROTV). 

Sections  II  and  III  of  this  paper  describe  approaches  for  au¬ 
tomatic  change  detection  and  introduces  CCD.  Section  IV  pro¬ 
vides  an  example  of  noncoherent  change  detection  using  the 
AUV-mounted  SAS.  Section  V  describes  a  coherent  change 
detection  experiment  using  the  ROTV-mounted  SAS.  Section 
VI  discusses  the  findings  to  date  and  charts  future  directions. 

II.  Background 

Change  detection  methods  are  categorized  based  on  their  un¬ 
supervised  or  supervised  nature.  The  first  category  is  correla¬ 
tion-based  and  compares  multi-temporal  image  data.  The 
second  category  typically  is  feature-based  and  involves  match¬ 
ing  algorithms.  In  airborne  radar  applications,  correlation- 
based  ACD  was  developed  first,  feature -based  ACD  came  later, 
and  the  two  approaches  are  being  fused  in  the  synthetic  aper¬ 
ture  radar  (SAR)  research  community  [1].  In  sonar,  due  to 
challenges  in  navigation  (trajectory  control  and  accurate  geo¬ 
registration),  the  complexity  of  the  propagation  environment, 
and  the  radiometric  inconsistencies  of  conventional  sidescan 
sonars,  feature -based  approaches  were  developed  first  (e.g.  the 
methods  of  Gendron  et  al.  [2]).  Only  in  recent  years,  with  the 
advent  of  synthetic  aperture  sonars  and  actively  navigated  plat¬ 
forms,  have  correlation-based  methods  been  shown  to  be  feasi¬ 
ble  [3]. 
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Synthetic  aperture  sonars  produce  range-independent,  fine 
resolution  seafloor  images.  With  centimetric  resolution  demon¬ 
strated  out  to  hundreds  of  meters,  these  systems  are  well  suited 
for  classifying  small  manmade  objects.  When  mounted  on  ac¬ 
tively  navigated  platforms  capable  of  accurately  repeating  sur¬ 
vey  tracks,  radiometric  inconsistencies  between  old  and  new 
data  are  minimized.  For  SAS  systems,  incoherent  and  coherent 
correlation-based  ACD  approaches  are  possible,  where  the 
former  identifies  changes  in  mean  backscatter  power  of  a  scene, 
and  the  latter  identifies  changes  in  both  the  amplitude  and 
phase  of  the  transduced  imagery  that  arise  in  the  interval  be¬ 
tween  collections.  For  radar  it  is  generally  accepted  that 
processing  the  complex  imagery  is  necessary  for  detecting 
changes  on  the  scale  of  small  man-made  objects  [4],  and  it  is 
likely  that  robust  correlation-based  ACD  for  sonar  systems  will 
follow  suit.  As  conventional  sidescan  sonars  exhibit  resolution 
that  degrades  with  range  and  are  typically  limited  to  creation  of 
backscatter  amplitude  images,  they  are  less  suitable  for  small- 
scale  correlation-based  ACD — thus  explaining  early  adaption 
of  feature-based  ACD  for  sidescan  systems. 

III.  Correlation-Based  Change  Detection 

The  correlation-based  change  detection  process  is  outlined  in 
Fig.  1.  Baseline  and  repeat-pass  images  are  geographically  co¬ 
registered  onto  a  single  grid.  A  correlation  map  between  the 
two  images  is  computed,  where  it  follows  that  changes  be¬ 
tween  the  two  scenes  produce  areas  of  low  correlation.  These 
“decorrelation”  contacts  are  detected,  and  features  correspond¬ 
ing  to  these  areas  are  used  by  an  automatic  target  recognition 
module  (ATR)  or  operator  to  classify  the  contacts  as  of  interest 
or  not. 

Baseline 


Image 


Fig.  1.  General  Block  Diagram  For  Correlation-based 
Automatic  Change  Detection 

We  explored  two  methods  of  image  co-registration.  Com¬ 
mon  to  each  approach  is  an  initial  gross  alignment:  where  sen¬ 
sor  altitude  is  used  to  transform  slant  range  to  ground  range, 
and  latitude,  longitude  and  heading  outputs  from  the  navigation 
suite  are  used  to  locate  each  pixel.  For  AUV  and  ROTV  SAS 
data,  fine-scale  co-registration  was  carried  out  using  the  me¬ 
thods  of  parcel  cross-correlation  and  iterative  trajectory  re¬ 
finement,  respectively,  which  are  described  in  the  following 
sections. 

IV.  Experiment  with  AUV-mounted  SAS 

To  test  the  feasibility  of  applying  correlation-based  change 
detection  to  SAS  imagery,  repeat  passes  over  a  relatively  fea¬ 
tureless  bottom  were  conducted  with  a  120-kHz,  10-cm  resolu¬ 
tion  EdgeTech  4400  SAS  mounted  on  a  HUGIN  1000  AUV 


(Fig.  2)  in  2004.  The  baseline  pass  image  is  shown  in  Fig.  3a. 
The  image  for  a  repeat  pass  conducted  two  hours  later  is  shown 
in  Fig.  3b,  into  which  a  simulated  contact  was  injected  at  range 
of  35  m.  The  simulated  contact  consists  of  a  50  cmx50  cm 
patch,  for  which  the  pixel  magnitudes  were  scaled  by  a  factor 
of  four.  The  images  were  converted  to  a  common  grid  and  sub¬ 
sequently  divided  into  2.5  mx2.5  m  parcels.  Parcels  were 
cross-correlated  between  scenes  to  find  the  two-dimensional 
translations  that  maximize  the  correlation.  From  these  transla¬ 
tions,  a  “rubber-sheet”  warp  map  was  constructed  and  used  to 
adjust  the  images  to  minimize  geo-registration  errors. 

The  inter-scene  correlation  map  of  the  warped  images  is 
shown  in  Fig.  3c,  where  it  is  observed  that  the  majority  of  the 
area  exhibits  a  correlation  of  greater  than  0.7,  and  the  injected 
contact  causes  a  significant  local  drop  in  correlation  (0.6).  A 
detector  based  on  a  statistical  model  of  the  correlation  distribu¬ 
tion  automatically  determines  an  optimal  threshold  segmenting 
the  contact  from  the  rest  of  the  map  (Fig.  3d).  Note  that  the 
equally  bright  real  contact  in  both  images  has  been  rejected  and 
the  results  reveal  only  changes  between  the  scenes. 


Fig.  2.  HUGIN  1000  with  EdgeTech  4400  SAS 

The  procedure  described  for  Fig.  3  was  carried  out  solely 
with  the  amplitude  images.  Correlation  with  amplitude  is  more 
robust  against  image  co-registration  errors  and  a  non-static 
environment  than  complex  coherence.  Utilizing  the  amplitude 
images,  this  example  shows  that  correlation-based  change  de¬ 
tection  can  be  successfully  carried  out  when  an  ideal  reflector 
is  injected  into  a  tractable  data  set — in  this  case,  two  well- 
matched  tracks  (range  offset  on  the  order  of  1  m)  and  a  statio¬ 
nary  environment. 

V.  Experiment  with  ROTV-mounted  SAS 

To  test  coherent  change  detection  with  real  objects,  a  175- 
kHz,  2. 5 -cm  resolution  AST  SAS  mounted  on  a  FOCUS-2 
ROTV  (Fig.  4  and  [6])  was  used  to  conduct  repeat  survey 
tracks  in  an  estuary  environment.  The  FOCUS-2  is  a  dynami¬ 
cally  controlled  tow  vehicle  with  a  guidance  suite  that  inte¬ 
grates  inertial  navigation  and  ultrashort  baseline  systems  (INS, 
USBL)  with  a  Doppler  velocity  log  (DVL),  allowing  accurate 
following  of  pre-programmed  tracks,  semi-independent  of  ship 
motion. 


First  pass 


Second  pass  with  “injected”  change 


Fig.  3.  Change  Detection  Example:  Image  Warping  Using  Parcel  Cross-Correlation.  Images  are  from  port  array. 

After  completion  of  the  baseline  track,  a  triangular  pyramid 
target,  constructed  of  1.2-m  rebar  sides  and  draped  in  chicken 
wire  (Fig.  5),  was  deployed  and  resurveyed  90  minutes  later. 

The  trajectory  of  the  repeat  pass  was  executed  within  4  meters 
of  the  original — the  target  positioned  approximately  50  m  to 
starboard.  Co-registered  image  segments  of  the  baseline  and 
repeat  pass  are  shown  in  Fig.  6;  where  the  newly  laid  target  is 
clearly  visible  in  the  center  of  panel  (b). 


Fig.  5.  Proxy  Target:  Triangular  Pyramid 

For  image  co-registration,  we  initially  tried  the  parcel  cross¬ 
correlation  method  described  in  Sec.  IV.  The  inter-scene  am¬ 
plitude-only  correlation  plot  (Fig.  7)  resulting  from  this  opera¬ 
tion  shows  that  while  the  majority  of  the  area  correlates  above 
0.65,  roughly  one  third  of  the  area  has  correlation  values  of 
less  than  0.65 — a  baseline  co-registration  insufficiently  robust 
to  support  correlation-based  change  detection  (whether  cohe¬ 
rent  or  noncoherent). 


Fig.  4.  ProSAS  Surveyor:  AST  SAS  and  MacArtney  ROTV 


Fig.  6.  Baseline  (a)  and  repeat  pass  (b)  images  after  co-registration  by  trajectory  refinement  warping.  The  vehicle  track  is  norther¬ 
ly  and  images  are  from  the  starboard  array.  The  target  and  its  float  lines  are  visible  in  the  center  of  panel  (b). 


Since  the  parcel  cross-correlation  warping  uses  only  transla¬ 
tions,  distortions  caused  by  trajectory  rotations  or  twisting  are 
not  corrected.  We  expect  a  generalized  warp  map  that  includes 
both  translation  and  rotation  will  produce  correlation  maps 
sufficient  for  automated  coherent  change  detection  and  will 
explore  these  procedures  in  future  work. 
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Fig.  7.  Correlation  maps  between  amplitude  images  of  the  baseline  pass  and 
repeat  passes  after  application  of  the  parcel  cross-correlation  warping  method. 
The  circle  designates  target  location. 


A  second  co-registration  method  being  explored  involves 
image  warping  based  on  iterative  trajectory  refinement,  devel¬ 


oped  by  AST  and  User  Systems  Inc.  for  synthetic  aperture  ra¬ 
dar  CCD.  A  significant  portion  of  the  co-registration  error  is 
hypothesized  to  be  due  to  deviations  between  the  recorded  na¬ 
vigation  of  the  sensor  and  its  actual  trajectory  [7].  Accordingly, 
the  co-registration  method  attempts  to  correctly  adjust  the  sen¬ 
sor  trajectory  used  to  map  the  scene.  Parcels  of  high  inter¬ 
scene  correlation  are  used  as  tie-points,  around  which  sensor 
trajectories  are  iteratively  modified  to  maximize  overall  inter¬ 
scene  coherence.  The  technique  is  in  the  process  of  being 
adapted  to  SAS  image  formation,  and  currently  precludes  key 
SAS  processing  steps  like  Redundant  Phase  Center  motion 
compensation  [8].  Preliminary  results  are  explored  here. 

The  co-registered  baseline  and  repeat  pass  images  resulting 
from  the  trajectory  refinement  warping  method  are  shown  in 
Fig.  6.  These  two  scenes  are,  to  the  eye,  very  well  correlated — 
with  the  exception  of  the  added  target  in  the  repeat  pass,  and 
some  contrast  in  shadow  depth  resulting  from  the  original  tra¬ 
jectory  differential.  Fig.  8a  shows  the  magnitude  of  the  com¬ 
plex  correlation  map,  and  Fig  8b  shows  the  phase  difference 
map — calculated  by  subtracting  the  complex  phases  of  the  im¬ 
ages.  The  overall  correlation  is  modest;  however,  some  regions 
in  the  image  show  excellent  correlation.  These  are  manifest  by 
bright  spots  in  the  correlation  map  and  corresponding  interfe¬ 
rence  fringes  in  the  phase  difference  map — regions  that  serve 
as  primary  tie  points  for  the  algorithm.  The  existence  of  these 
features  indicates  that  the  data  is  suitable  for  CCD  and  that  the 
fundamentals  of  the  co-registration  algorithm  are  working  due 
to  sufficient  spectral  overlap  between  the  passes  [9].  We  antic¬ 
ipate  that  significant  increases  in  inter-scene  coherence  will 


result  from  integration  of  the  trajectory  refinement  algorithm 
into  the  SAS  processor. 


Fig.  8.  Preliminary  results  of  trajectory  refinement  warp  technique:  (a)  Magni¬ 
tude  of  complex  correlation  map.  Bright  areas  are  regions  of  high  inter-scene 
coherence;  (b)  Phase  difference  map.  The  circles  designate  target  location. 

VI.  Discussion 

Using  a  data  set  collected  with  an  AUV-mounted  120-kHz, 
10-cm  resolution  SAS,  a  noncoherent  example  demonstrated 
the  utility  of  correlation-based  automatic  change  detection  for 
alerting  to  the  presence  of  objects  newly  introduced  to  the  sea¬ 
floor.  This  data  set  was  well-suited  for  correlation-based  ACD, 
in  that  it  exhibited  the  fine,  range-independent  resolution  of  a 
SAS  system,  and  was  characterized  by  a  1-m  track  repetition, 
stationary  environment,  and  an  idealized,  synthetically  inserted 
target.  Image  co-registration  was  achieved  with  a  two-stage 
process  of  initial  gross  alignment,  followed  by  parcel  cross¬ 
correlation  warping.  However,  short  SAS  frame  lengths  intro¬ 
duced  phase  discontinuities  that  make  computation  of  the  com¬ 
plex  inter- scene  correlation  more  difficult.  For  this  initial  study, 
we  have  not  yet  implemented  the  adjustments  necessary  to  find 
complex  correlation  across  frames. 

To  take  advantage  of  the  increased  sensitivity  of  coherent 
processing  that  SAS  affords,  a  repeat  pass  experiment  was 
conducted  using  an  ROTV-mounted  175 -kHz,  2. 5 -cm  resolu¬ 
tion  SAS,  and  deployment  of  a  real  target.  SAS  frames  of  ex¬ 
tended  lengths  were  generated;  however,  the  parcel  cross¬ 
correlation  method  was  insufficient  to  adequately  co-register 
the  two  images,  as  it  successfully  did  for  the  AUV  example. 
This  result  is  likely  a  function  of  trajectory  and  wavelength. 
The  change  in  imaging  geometry  caused  by  the  4-meter  lateral 
offset  of  the  ROTV  passes  likely  contributed  to  loss  of  inter¬ 
scene  coherence — an  offset  that  will  be  reduced  with  more 
experience  programming  and  operating  the  ROTV  for  SAS 
surveys.  Spatial  coherence  also  degrades  with  reduction  in 
acoustic  wavelength — where  the  wavelength  of  the  ROTV 
SAS  (0.86  cm)  is  thirty  percent  shorter  than  that  of  the  AUV 
SAS  (1.25  cm).  (Other  factors  can  include  environmental  com¬ 
plexity,  temporal  stationarity,  system  noise,  and  data 
processing  imperfections.)  Initial  testing  of  a  trajectory  refine¬ 


ment  warping  technique  developed  for  SAR  CCD  produced 
results  indicating  that  proper  integration  into  the  SAS  proces¬ 
sor  will  result  in  co-registration  adequate  for  SAS  CCD. 

Future  work  includes  integration  of  SAR  co-registration  me¬ 
thods  into  the  SAS  processor,  fine  tuning  vehicle  settings  for 
more  accurate  track  repetition  in  both  AUV  and  active  towfish 
operations,  and  exploration  of  lower  acoustic  frequencies  and 
more  suitable  imaging  geometries  in  order  to  reduce  baseline 
decorrelation. 
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